ACCESS CONTROL SYSTEM WITH SYMBOL RECOGNITION 

FIELD 

5 The invention is in the field of access control, namely 

preventing unauthorized individuals from entering secured 
areas, or from accessing secured information, or from 
performing privileged transactions, 

10 BACKGROUND 

In the following discussion, the term 'secured area' is 
used generically to refer to any type of physical or virtual 
O facility having privileged access, such as the rooms of a 

yy 15 secure facility, or information on a computer, or functions 
m of a computer, or the privilege to perform financial 

|Vj transactions. The term v user ' is used to refer to a person 

n attempting to access a secured area. 

:£ 20 The purpose of an access control system is to determine 

■ass. 

Jr; if a person attempting to enter a secured area is authorized 

to do so. There are three basic elements to validating 
access privileges, which can be simply summarized as "who 
you are", "what you know" , and "what you have". Each of 
25 these elements has strengths and weaknesses. Therefore, a 
given access control system might use one or more of these 
elements, with the most secure systems requiring all three. 

Access control systems that validate "who you are" most 
3 0 commonly require a person (such as a security guard) to 

verify the identity of the user. Alternatively this can be 
automated using biometric validation methods such as 



fingerprint matching, face recognition, or iris scans. The 
"who you are" element of security is typically the hardest 
to automate reliably. However "who you are" is not 
transferable to other individuals, in contrast to the other 
two elements of validating access which are easily 
transferred, and so more easily compromised. 

Access control systems that validate "what you know" 
require that the user recall a password or PIN number 
(personal identification number) . A common method to 
provide this information would be through a keypad attached 
to the access control system. This is the most common 
method of access control for computer usage, where the user 
is required to enter a username and password to gain access 
to the computers information and programs. This is the 
easiest security element to grant to a user because it does 
not require creating any physical entity like a key. 

Access control systems that validate "what you have" 
require that the person carry an identity badge or access 
key. A conventional door lock uses this method. Magnetic 
card readers and radio frequency tags are other examples of 
access control based on "what you have". An advantage of a 
key entry method is that a completely mechanical solution is 
possible, which is ideal where electrical power is not 
available. A key or card is easy to transfer from one 
person to another. 



Access control systems requiring "what you know" and 
"what you have" are very common. For example automated 
teller machines (ATMs) require that the user swipe a debit 
card through a magnetic card reader and also provide a PIN 
5 number. Another example is electronically locked doors 

leading to secure areas in airports, which often have a card 
reader and a keypad for entering an access code. Such 
systems make it very difficult for lost or stolen cards to 
be used to access the system. 

10 

A common problem with any automated access control 
system is known as 'piggy backing' . This is where one user 
allows several others to gain access to the secure area 
without requiring them to validate their authority to do so. 

15 For example, an employee may swipe their card through a 
reader to unlock a door and then allow several others 
through at the same time. In organizations with a large 
number of employees, it is therefore fairly easy for someone 
to appear as a legitimate employee and gain access to a 

20 secure area through 'piggy backing' into the area. The 

alternative of having a security guard at each access point 
is costly and not a very good utilization of the security 
guard's time. A security camera located at the door can act 
as a deterrent to 'piggy backing', but must be monitored by 

2 5 a security guard to be effective. 

One system that attempts to address this issue is 
described in U.S. Patent No. 4,581,634 issued to Williams. 
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Williams describes a two-piece system that uses a 
conventional badge-reading system in combination with a 
camera for viewing the badge holder's face. However, the 
Williams apparatus requires two cameras to operate, one to 
read the badge and one to capture the badge holder's face. 
The two-camera design requires additional equipment 
expenses, as well as additional processing and bandwidth 
overhead. Also, the Williams apparatus is directed to 
photographic identification badges, which are at a greater 
risk of forgery than bar codes or symbol badges that link to 
an information database. Lastly, the Williams apparatus is 
designed to be controlled by an operator, and automating the 
apparatus would expose it to a security breach due to the 
forgery possibilities described above. 

A further disadvantage of systems such as magnetic card 
readers and the Williams apparatus is that they require 
physical contact with the card and so require periodic 
maintenance to function reliably. They are also subject to 
tampering and vandalism. 

U.S. Patent No. 5,682,03 0 issued to Kubon describes a 
method and apparatus for decoding bar codes from an analog 
video signal. Kubon is directed to replacing traditional 
bar code scanners with video cameras to allow for bar code 
scanning at a greater distance. Kubon is limited by 
requiring a digitizer to handle analog signals and also by 



requiring a minimum 25% of the visible area to be covered by 
the bar code. 

U.S. Patent Application Publication 2002/0003575, 
applied for by Marchese, describes a digital video system 
using networked cameras . Marchese describes a method of 
capturing and storing video streams from cameras on the 
network into single files, with indexing to search for 
individual images. The design allows for the individual 
computers on the network to access the stored images and 
monitor the cameras. The only security measure provided in 
the Marchese system is motion detection based on color 
component value comparisons from different images. While 
this type of motion detection is commonly used, it is 
inefficient and unwieldy for security purposes in areas that 
require regular access from security-cleared personnel. 

The object of the present invention is to mitigate the 
above drawbacks by integrating the functionality of all 
three identity validation methods mentioned above through a 
security camera that is used to also read identity badges. 
A computer network associated with one or more cameras 
facilitates badge recognition, user validation, centralized 
management, and control of the access control system. 

SUMMARY OF INVENTION 

A video camera is located at a secure access point and 
is connected to a computer network. The camera is used as a 
conventional security camera and also provides automated 



assistance with access control. When an identity badge is 
presented to the camera by a person requesting access to the 
facility, a computer that is monitoring the camera 
recognizes a bar code or other symbols on the badge and 
5 accesses a database to locate information associated with 
that identity badge. This information is then used to 
determine if the person should be granted access. 

For example, the information could be presented to a 
10 remote security guard who is controlling the access point to 
help the guard to validate that the person seen in the video 
image is allowed access to the secure facility. To allow 
access, the guard then remotely commands the door to unlock, 
for example through a signal to the camera to turn on a 
15 relay connected to the door's locking mechanism. 

Optionally, one or more images of each access attempt are 
stored in the database for future review in the event of any 
security breach. 

2 0 Additionally, the guard may use an audio link supported 

by the network and camera to query the person who is seeking 
access to further verify their identity and/or reason for 
entering the facility. Optionally, speaker verification 
software is used to validate that the user's voice matches 

2 5 data about the users voice stored in the database. 

Optionally, face verification software is used to validate 
that the face seen by the camera is the same as the face 
data stored in the database. 
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The system may also be automated using face and/or 
voice verification software to eliminate the need for a 
remote security guard at the access control computer. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The invention itself both as to organization and method 
of operation, as well as additional objects and advantages 
10 thereof, will become readily apparent from the following 
detailed description when read in connection with the 
accompanying drawings: 

Figure 1 is a diagram of an access control system using a 
ffi 15 digital camera; 

yj Figure 2a is a front view of an identity badge; 

p Figure 2b is a rear view of an identity badge; 

q 20 Figure 2c is a front view of an alternate identity badge; 
PJ Figure 3 is a diagram of an access control system using an 

analog camera; 

25 DETAILED DESCRIPTION 

The access control system 10 diagrammed in Figure 1 
consists of a camera 12 connected to a computer network 14. 
The camera 12 is designed to take digital images of identity 
3 0 (ID) badges 30 (shown in Figures 2a, 2b, and 2c) and 

individuals with its field of view. Also connected to the 
computer network 14 are a badge reading computer 16, a 
database 18, and an access control computer 20. 
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In operation, the camera 12 scans an ID badge 30 (shown 
in Figure 2a) and sends the resulting digital image into the 
computer network 14. The badge reading computer 16 
interprets the bar code 36 on the ID badge 30 and retrieves 
information about the badge and badge holder from the 
database 18. The database information is passed to the 
access control computer 20 where an operator determines if 
access is to be allowed. Alternatively, the access control 
computer 20 can retrieve the information from the database 
18 after receiving the bar code interpretation from the 
badge reading computer 16. The digital images and database 
information may also be sent to a storage unit 22 for future 
reference in the event of a security breach. Once the 
operator determines that access is allowed, the security 
restraints are lifted, for example, by electronically 
deactivating a door lock 24. 

By combining the badge reading function with the 
imaging function in a single camera 12, the user need not be 
aware that both functions are present. Therefore, the 
system can be used in a covert manner. For example, the 
system may be presented as a simple badge reader, with the 
user unaware that the system is also acting as an image 
recorder. 

To provide greater interaction between the access 
control operator and the badge holder, an audio 
communication system can also be included. One-way 
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communication 26 from the operator to the badge holder (to 
give instructions) or one-way communication 28 from the 
badge holder to the operator (to provide a voice sample for 
recognition) or a combination of the two may be used. The 
audio can be integrated into the camera 12, separately 
connected to the network 14 or directly sent to the access 
control computer 20. More generally, the audio 
communications elements may be configured in any fashion to 
meet the desired security requirements of the access control 
system 10. 

Depending on the required level of security, and the 
available information in the database 18, different means of 
confirming the identity of the badge holder may be used. 
The simplest is comparison, by the operator, of the face of 
the badge holder in the digital image with the image on 
record in the database. The operator may further require 
the badge holder to provide a password, to match with one 
recorded in the database. Additional security means can be 
added in layers or incorporated from existing systems. For 
example, as opposed to unlocking a door when access is 
granted, the operator may instead activate a keypad, from 
which the badge holder must input a password or personal 
identification number (PIN) . However, such measures are 
cumbersome, and are only recommended in areas where extreme 
levels of security are required. 
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The access control system 10 may be automated, 
eliminating the need for an operator. The access control 
computer 20 would then contain face verification software to 
compare the face in the digital image with the face stored 
in the database 18. In the event of a positive match, the 
system would then automatically allow access to the secure 
area. Voice verification, or a combination of voice and 
face verification may also be used in a similar fashion. 

The recording of digital images to the storage unit 22, 
besides providing a record of events in case of a security 
breach, also allows for additional functions to be 
implemented in the access control system 10. For example, 
software could be provided on the access control computer 
20, the badge reading computer 16 and/or the camera 12 that 
counts people using the digital images, thereby allowing the 
system to detect "piggy backing" attempts or similar 
incidents and providing a warning to the system operator or 
other security personnel. 

Figure 2a shows a front view of a standard ID badge 30. 
A photograph 32 of the badge holder along with their 
personal information 34 (name, title, etc.) covers the 
surface. Figure 2b shows a rear view of the same badge with 
the bar code 36 taking up the majority of the surface and 
magnetic strip 38 located at the bottom. The badge shown in 
Figures 2a and 2b is designed to combine all standard ID 
means in one badge. One alternative badge is shown in 

10 



Figure 2c, with the photograph 32, bar code 36 and magnetic 
strip 38 all located on the front. Obviously, different 
combinations of these elements are possible, and not all 
elements need be included. For example, with the badge 
5 holder's photograph already stored in the database 18, there 
is no need for the ID badge 30 to also include a photograph 
32. In effect, ID badges 30 can be reduced down to only bar 
codes 36 if desired, although in many cases it will be more 
practical to include an easily recognized identifier, such 
10 as a photograph 32 or personal information 34. 

Bar codes 36 are described as the most common security 
identifier for the ID badges 30. However, given appropriate 
character-recognition software, any suitable symbols can be 

15 used. For example, a company may provide "visitor" badges 
with a corporate logo that allow limited access to secure 
areas, while regular employees have bar codes, or a 
symbol /barcode combination. The OCR software in the badge 
reading computer 16 is the limiting factor in the 

2 0 interpretation. As digital images are used, it is also 
possible to differentiate badges based on color, or 
combination of colors. As color is identifiable at a 
greater distance than black and white bar codes, a badge 
scheme using color-coding will operate at a greater distance 

2 5 from the camera and require less of the badge in the field 
of view. 



11 



By using bar codes or other symbols, the amount of 
information gleaned from the badge 30 is minimized. This 
acts to make duplication or forgeries of badges 30 
ineffective as a means of gaining illegal access, because 
without a corresponding modification of the database 18, the 
duplicate/ forgery is worthless. 

Other combinations of cameras and computers may be 
used. For example, an access control system with a single 
camera may incorporate the badge reading functions into the 
camera 12, and combine the database 18 and video storage 22 
into the access control computer 20. Alternatively, all 
network functions (badge reading, database, video storage, 
and access control) can be combined into a single computer 
connected to one or more cameras. The result of combining 
multiple functions into single components is an access 
control system that provides all the desired functionality 
with a minimum number of disparate components and at a 
typically reduced cost. 

By contrast, a large access control system could 
require a large number of cameras 12. In this case, the 
cameras 12 would simply transmit images, to minimize the 
cost of the individual cameras 12. Multiple cameras 12 may 
further require multiple access control computer 20 tied 
into the computer network 14. The database 18 and video 
storage 22 are maintained separately to allow any access 
control computer 20 to retrieve required information. The 
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badge reading computer 16 can be either part of the access 
control computer 20 or a separate element depending on the 
desired nature of the system and which combination optimizes 
network bandwidth use and system costs. 

The symbol recognition can also be used to extend the 
functionality of the access control system 10. For example, 
a badge 30 could have a symbol pattern that is used to 
signal that a camera 12 is authorized for a remote software 
update, and specify which version of software the camera 
should fetch and from where on the network. Similarly, a 
badge 30 could be used to change the operating mode of a 
camera 12 by holding up a badge 30 specifying the mode 
parameters, and the authorization code to modify those 
parameters . 

Furthermore, the access control system 10 could be used 
for personnel tracking. A security guard could signal his 
presence in the area near a camera 12 by showing his badge 
30 to the camera 12. Knowing the whereabouts of security 
personnel can be especially helpful in the event of an 
emergency where the people closest to the area needing 
attention can be quickly determined and notified. 

In an alternative embodiment shown in Figure 3, the 
access control system 10 may use a camera or cameras 12 that 
provide analog images instead of digital images. In this 
case, the analog images are sent from the camera 12 to an 



13 



analog/digital decoder 40 which coverts the analog images 
into digital images. The digital images are the passed to 
the computer network 14 and the process continues as 
described above for Figure 1. The access control system 10 
5 may also include an analog video monitor 42 and analog video 
storage 44, for viewing and recording of the original analog 
images, if desired. 

Accordingly, while this invention has been described 
10 with reference to illustrative embodiments, this description 
is not intended to be construed in a limiting sense. 
Various modifications of the illustrative embodiments, as 
well as other embodiments of the invention, will be apparent 
to persons skilled in the art upon reference to this 
15 description. It is therefore contemplated that the appended 
claims will cover any such modifications or embodiments as 
fall within the scope of the invention. 
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